Augmented reality integration in electronic gaming machines

ABSTRACT

An electronic gaming machine according to some embodiments includes a processing circuit, a display screen coupled to the processing circuit, and a transceiver coupled to the processing circuit and providing wireless communications with an augmented reality (AR) display device that is separate from the electronic gaming machine. The processing circuit displays a game element in a first screen area of the display screen, and transmits, via the transceiver, screen location data to the AR display device identifying a second screen area on the display screen, other than the first screen area, that is available for the AR display device to overlay AR graphics in a field of view of a user of the AR display device without overlaying the game element displayed in the first screen area of the display screen.

BACKGROUND

Embodiments described herein relate to augmented reality systems andmethods, and in particular to electronic gaming machines thatinteroperate with augmented reality systems.

Electronic gaming machines (EGMs) are systems that allow users to placea wager on the outcome of a random event, such as the spinning ofmechanical or virtual reels or wheels, the playing of virtual cards, therolling of mechanical or virtual dice, the random placement of tiles ona screen, etc. Manufacturers of EGMs have incorporated a number ofenhancements to the EGMs to allow players to interact with the EGMs innew and more engaging ways. For example, early slot machines allowedplayer interaction by pulling a lever or arm on the machine. Asmechanical slot machines were replaced by electronic slot machines, arange of new player interface devices became available to EGM designersand were subsequently incorporated into EGMs. Examples of such interfacedevices include electronic buttons, wheels, and, more recently,touchscreens and three-dimensional display screens.

SUMMARY

An electronic gaming machine according to some embodiments includes aprocessing circuit, a display screen coupled to the processing circuit,and a transceiver coupled to the processing circuit and configured toprovide wireless communications with an augmented reality (AR) displaydevice that is separate from the electronic gaming machine. Theprocessing circuit displays a game element in a first screen area of thedisplay screen, and transmits, via the transceiver, screen location datato the AR display device identifying a second screen area on the displayscreen, other than the first screen area, that is available for the ARdisplay device to overlay AR graphics in a field of view of a user ofthe AR display device without overlaying the game element displayed inthe first screen area of the display screen.

The element may include a first game element, and the processing circuitmay transmit a second game element to the AR device for display by theAR device in the second screen area of the display screen.

The processing circuit may transmit a second game element to the ARdevice for display by the AR device outside of the display screen.

The processing circuit may transmit a state of the game element to theAR device. The state of the game element determines whether the ARdevice is permitted to overlay AR graphics in the field of view of theuser of the AR device over the game element.

The processing circuit may transmit an updated state of the game elementto the AR device in response to detecting a change in the state of thegame element.

The processing circuit may transmit a code to the AR device thatindicates when the AR device can use the second screen area to displayAR graphics.

The screen location data may include locations of game elements that arelegally or contractually required to be displayed by the electronicgaming machine.

The screen location data may include a reel position of a virtual reeldisplayed on the display screen, a payline location, a service windowlocation and/or a credit meter location.

The processing circuit may transmit to the AR device a reel state of avirtual reel displayed on the display screen, payline state, servicewindow state, payline wins, credit meter changes, win animations, and/orsystem events.

The processing circuit may transmit information to the AR device aboutlocation of a peripheral device on a cabinet of the electronic gamingmachine outside the display screen.

The processing circuit may transmit a second game element to the ARdevice and to transmit a command to the AR device to display the secondgame element within the field of view of the user.

The processing circuit may transmit screen location data identifying athird screen location, and the command instructs the AR device todisplay the second game element to overlay the third screen location inthe field of view of the user.

The screen location data may identify a plurality of screen areas inwhich game elements are displayed that are not to be obscured by imagesdisplayed by the AR device.

An augmented reality device according to some embodiments includes aprocessing circuit, a transceiver coupled to the processing circuit, anda display device coupled to the processing circuit and configured todisplay virtual images within a field of view of a user. The processingcircuit receives, via the transceiver, screen location data from anelectronic gaming machine including a display screen within the field ofview of the user, the screen location data identifying a first screenarea on the display screen, and displays a virtual game element in thefield of view of the user outside the first screen area of the displayscreen.

The processing circuit may receive a game event from the electronicgaming machine, and to display the virtual game element in response tothe game event.

The screen location data may identify a second screen area on thedisplay screen that is distinct from the first screen area, and theprocessing circuit may display the virtual game element to overlay thesecond screen area on the display screen.

The processing circuit may display the virtual game element outside thedisplay screen.

The processing circuit may receive a second virtual game element fromthe electronic gaming machine and display the second virtual gameelement within the field of view of the user.

The processing circuit may receive a state of the second game elementand display the second game element overlaying the first screen area ofthe display screen in response to the state of the second game element.

The augmented processing circuit may receive an updated state of thesecond game element from the electronic gaming machine in response to achange in the state of the second game element.

The screen location data may include a reel position of a virtual reeldisplayed on the display screen, a payline location, a service windowlocation and/or a credit meter location.

The processing circuit may receive state information including a reelstate of a virtual reel displayed on the display screen, a paylinestate, a service window state, payline wins, credit meter changes, winanimations, and/or system events, and the processing circuit may displaythe virtual game element in response to the state information.

The processing circuit may receive peripheral information about locationof a peripheral device on a cabinet of the electronic gaming machineoutside the display screen, and the processing circuit may display thevirtual game element in response to the peripheral information.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram illustrating a network configurationfor a plurality of gaming devices according to some embodiments.

FIGS. 2A to 2D illustrate augmented reality viewing devices according tovarious embodiments.

FIG. 2E is a schematic block diagram of an augmented reality deviceaccording to some embodiments.

FIG. 3A is a perspective view of an electronic gaming device that can beconfigured according to some embodiments.

FIG. 3B is a schematic block diagram illustrating an electronicconfiguration for a gaming device according to some embodiments.

FIG. 3C is a schematic block diagram that illustrates various functionalmodules of an electronic gaming device according to some embodiments.

FIG. 3D is perspective view of a handheld electronic gaming device thatcan be configured according to some embodiments.

FIG. 3E is a perspective view of an electronic gaming device accordingto further embodiments.

FIGS. 4A and 4B illustrate portions of a display screen of an electronicgaming machine according to some embodiments.

FIG. 4C is a timeline that illustrates various phases of operation of anelectronic gaming machine according to some embodiments.

FIGS. 4D, 4E and 4F illustrate portions of a display screen of anelectronic gaming machine according to some embodiments.

FIG. 5A is a flow diagram illustrating message flows between anelectronic gaming machine and an augmented reality device according tosome embodiments.

FIG. 5B is a flow diagram illustrating message flows between anelectronic gaming machine, an augmented reality device and an augmentedreality controller according to some embodiments.

FIGS. 6-9 are flowcharts illustrating operations of systems/methodsaccording to some embodiments.

FIG. 10 is a schematic block diagram illustrating an electronicconfiguration for an augmented reality controller according to someembodiments.

DETAILED DESCRIPTION

Embodiments of the inventive concepts provide systems and methods fordisplaying three-dimensional content on or in connection with anelectronic gaming machine (EGM), or even independently from an EGM, to aplayer of an EGM or an observer (non-player) who is watching a playerplay an EGM. The three dimensional content may be associated withcontent that is displayed on the EGM. According to various embodiments,the 3D content can be rendered to the player on an augmented realityviewer, such as an augmented reality headset that communicates with theEGM so that the 3D content displayed to the player on the augmentedreality headset is coordinated with the content displayed on the EGM.“Augmented reality” or “AR” may also be referred to as “mixed reality.”

Some embodiments provide a headset display with pass through mixedreality rendering. The 3D model and 3D scanner can be used to track andlocate objects, such as a user, a user's hand, other players, EGMs,etc., within an area, such as a casino floor. The headset display allowsthe user to see 3D virtual objects that appear to be physically presentin the real world. The headset display also allows the user to movearound while 3D rendered virtual objects (e.g. interface buttons,avatars, videos, personally pinned alerts/notifications/statistics etc.)may appear to stay in place or move along with the player. These andother embodiments are described in more detail below.

Augmented Reality EGM Systems and Viewers

Referring to FIG. 1, a gaming system 10 including a plurality of EGMs100 is illustrated. The gaming system 10 may be located, for example, onthe premises of a gaming establishment, such as a casino. The EGMs 100,which are typically situated on a casino floor, may be in communicationwith each other and/or at least one central controller 40 through a datanetwork or remote communication link 50. The data communication network50 may be a private data communication network that is operated, forexample, by the gaming facility that operates the EGM 100.Communications over the data communication network 50 may be encryptedfor security. The central controller 40 may be any suitable server orcomputing device which includes at least one processor and at least onememory or storage device. Each EGM 100 may include a processor thattransmits and receives events, messages, commands or any other suitabledata or signal between the EGM 100 and the central controller 40. TheEGM processor is operable to execute such communicated events, messagesor commands in conjunction with the operation of the EGM. Moreover, theprocessor of the central controller 40 is configured to transmit andreceive events, messages, commands or any other suitable data or signalbetween the central controller 40 and each of the individual EGMs 100.In some embodiments, one or more of the functions of the centralcontroller 40 may be performed by one or more EGM processors. Moreover,in some embodiments, one or more of the functions of one or more EGMprocessors as disclosed herein may be performed by the centralcontroller 40.

A wireless access point 160 provides wireless access to the datacommunication network 50. The wireless access point 160 may be connectedto the data communication network 50 as illustrated in FIG. 1, or may beconnected directly to the central controller 40 or another serverconnected to the data communication network 50.

A player tracking server 45 may also be connected through the datacommunication network 50. The player tracking server 45 may manage aplayer tracking account that tracks the player's gameplay and spendingand/or other player preferences and customizations, manages loyaltyawards for the player, manages funds deposited or advanced on behalf ofthe player, and other functions. Player information managed by theplayer tracking server 45 may be stored in a player information database47.

As further illustrated in FIG. 1, a mixed reality viewer 200, or ARdevice 200, is provided. The AR device 200 communicates with one or moreelements of the system 10 to render two dimensional (2D) and/or threedimensional (3D) content to a player of one of the EGMs 100 in a virtualspace, while at the same time allowing the player to see objects in thereal space around the player. That is, the AR device 200 combines avirtual image with real images perceived by the user, including imagesof real objects as well as images displayed by the EGM 100. In thismanner, the AR device 200 “mixes” real and virtual reality into a singleviewing experience for the player. In some embodiments, the AR device200 may be further configured to enable the player to interact with boththe real and virtual objects displayed to the player by the AR device200.

The AR device 200 communicates with one or more elements of the system10 to coordinate the rendering of mixed reality images, and in someembodiments mixed reality 3D images, to the player. For example, in someembodiments, the AR device 200 may communicate directly with an EGM 100over a wireless interface 202, which may be a WiFi link, a Bluetoothlink, an NFC link, etc. In other embodiments, the AR device 200 maycommunicate with the data communication network 50 (and devicesconnected thereto, including EGMs) over a wireless interface 204 withthe wireless access point 160. The wireless interface 204 may include aWiFi link, a Bluetooth link, an NFC link, etc. In still furtherembodiments, the AR device 200 may communicate simultaneously with boththe EGM 100 over the wireless interface 202 and the wireless accesspoint 160 over the wireless interface 204. In these embodiments, thewireless interface 202 and the wireless interface 204 may use differentcommunication protocols and/or different communication resources, suchas different frequencies, time slots, spreading codes, etc. For example,in some embodiments, the wireless interface 202 may be a Bluetooth link,while the wireless interface 204 may be a WiFi link.

The wireless interfaces 202, 204 allow the AR device 200 to coordinatethe generation and rendering of mixed reality images to the player viathe AR device 200.

In some embodiments, the gaming system 10 includes a mixed realitycontroller, or AR controller 70. The AR controller 70 may be a computingsystem that communicates through the data communication network 50 withthe EGMs 100 and the AR devices 200 to coordinate the generation andrendering of virtual images to one or more players using the AR devices200. The AR controller 70 may be implemented within or separately fromthe central controller 40.

In some embodiments, the AR controller 70 may coordinate the generationand display of the virtual images of the same virtual object to morethan one player by more than one AR device 200. As described in moredetail below, this may enable multiple players to interact with the samevirtual object together in real time. This feature can be used toprovide a shared multiplayer experience to multiple players at the sametime. In some embodiments, the AR controller 70 may be included withinthe AR device 100 itself.

Moreover, in some embodiments, the AR controller 70 may coordinate thegeneration and display of the same virtual object to players atdifferent physical locations, as will be described in more detail below.

The AR controller 70 may store a three dimensional wireframe map of agaming area, such as a casino floor, and may provide the threedimensional wireframe map to the AR devices 200. The wireframe map maystore various information about EGMs in the gaming area, such as theidentity, type and location of various types of EGMs. The threedimensional wireframe map may enable an AR device 200 to more quicklyand accurately determine its position and/or orientation within thegaming area, and also may enable the AR device 200 to assist the playerin navigating the gaming area while using the AR device 200.

In some embodiments, at least some processing of virtual images and/orobjects that are rendered by the AR devices 200 may be performed by theAR controller 70, thereby offloading at least some processingrequirements from the AR devices 200.

Referring to FIGS. 2A to 2D, the AR device 200 may be implemented in anumber of different ways. For example, referring to FIG. 2A, in someembodiments, an AR device 200A may be implemented as a 3D headsetincluding a pair of semitransparent lenses 212 on which images ofvirtual objects may be displayed. Different stereoscopic images may bedisplayed on the lenses 212 to create an appearance of depth, while thesemitransparent nature of the lenses 212 allow the user to see both thereal world as well as the 3D image rendered on the lenses 212. The ARdevice 200A may be implemented, for example, using a Hololens™ fromMicrosoft Corporation. The Microsoft Hololens includes a plurality ofcameras and other sensors 211 that the device uses to build a 3D modelof the space around the user. The device 200A can generate a 3D image todisplay to the user that takes into account the real world objectsaround the user and allows the user to interact with the 3D object.

The device 200A may further include other sensors, such as a gyroscopicsensor, a GPS sensor, one or more accelerometers, and/or other sensorsthat allow the device 200A to determine its position and orientation inspace. In further embodiments, the device 200A may include one or morecameras that allow the device 200A to determine its position and/ororientation in space using visual simultaneous localization and mapping(VSLAM). The device 200A may further include one or more microphonesand/or speakers that allow the user to interact audially with thedevice.

Referring to FIG. 2B, an AR device 200B may be implemented as a pair ofglasses 200B including a transparent prismatic display 214 that displaysan image to a single eye of the user. An example of such a device is theGoogle Glass device. Such a device may be capable of displaying imagesto the user while allowing the user to see the world around the user,and as such can be used as a mixed reality viewer. However, it will beappreciated that the device 200B may be incapable of displaying 3Dimages to the user.

In other embodiments, referring to FIG. 2C, the AR device may beimplemented using a virtual retinal display device 200C. In contrast todevices that display an image within the field of view of the user, avirtual retinal display raster scans an image directly onto the retinaof the user. Like the device 200B, the virtual retinal display device200C combines the displayed image with surrounding light to allow theuser to see both the real world and the displayed image. However, alsolike the device 200B, the virtual retinal display device 200C may beincapable of displaying 3D images to the user.

In still further embodiments, an AR device 200D may be implemented usinga mobile wireless device, such as a mobile telephone, a tablet computingdevice, a personal digital assistant, or the like. The device 200D maybe a handheld device including a housing 205 on which a touchscreendisplay device 216 including a digitizer 252 is provided. An inputbutton 230 may be provided on the housing and may act as a power orcontrol button. A rear facing camera 227 may be provided in a front faceof the housing 205. The device 200D may further include a front facingcamera 228 on a rear face of the housing 205. The device 200D mayinclude one or more speakers 250 and a microphone 229. The device 200Dmay provide a mixed reality display by capturing a video signal usingthe front facing camera 228 and displaying the video signal on thedisplay device 216, and also displaying a rendered image of a virtualobject over the captured video signal. In this manner, the user may seeboth a mixed image of both a real object in front of the device 200D aswell as a virtual object superimposed over the real object to provide amixed reality viewing experience.

FIG. 2E is a block diagram that illustrates various components of an ARdevice 200 according to some embodiment. As shown in FIG. 2E, the ARdevice 200 may include a processor 210 that controls operations of theAR device 200. Although illustrated as a single processor, multiplespecial purpose and/or general purpose processors and/or processor coresmay be provided in the AR device 200. For example, the AR device 200 mayinclude one or more of a video processor, a signal processor, a soundprocessor and/or a communication controller that performs one or morecontrol functions within the AR device 200. The processor 210 may bevariously referred to as a “controller,” “microcontroller,”“microprocessor” or simply a “computer.” The processor may furtherinclude one or more application-specific integrated circuits (ASICs).

Various components of the AR device 200 are illustrated in FIG. 2E asbeing connected to the processor 210. It will be appreciated that thecomponents may be connected to the processor 210 through a system bus, acommunication bus and controller, such as a USB controller and USB bus,a network interface, or any other suitable type of connection.

The AR device 200 further includes a camera 230 for generating a videosignal and a display 240 for displaying AR graphics to a user as virtualimages or virtual elements, and a microphone 229 for receiving audiosignals, such as voice commands from a user. The AR graphics may bedisplayed directly within a field of view so as to appear to be presentwithin a scene and/or may be digitally added to a live video signal soas to appear to be present within the live video signal.

The AR device 200 further includes a memory device 212 that stores oneor more functional modules 214 for performing the operations describedherein.

The memory device 212 may store program code and instructions,executable by the processor 210, to control the AR device 200. Thememory device 210 may include random access memory (RAM), which caninclude volatile and/or non-volatile RAM (NVRAM) and other forms ascommonly understood in the gaming industry. In some embodiments, thememory device 212 may include read only memory (ROM). In someembodiments, the memory device 212 may include flash memory and/orEEPROM (electrically erasable programmable read only memory). Any othersuitable magnetic, optical and/or semiconductor memory may operate inconjunction with the gaming device disclosed herein.

The AR device 200 may include a wireless interface 220 that enables theAR device 200 to communicate with remote devices, such as EGMs 100and/or an AR controller 70 over a wired and/or wireless communicationnetwork, such as a local area network (LAN), wide area network (WAN),cellular communication network, wireless LAN (Wifi), Bluetooth,nearfield communications (NFC) or other data communication network. Thewireless interface 220 may include multiple radios to support multipletypes of simultaneous connections. For example, the wireless interfacemay include both a Wifi radio transceiver and a Bluetooth radiotransceiver.

Electronic Gaming Machines

An example of an electronic gaming machine (EGM) that can interact withmixed reality viewers according to various embodiments is illustrated inFIGS. 3A, 3B, and 3C in which FIG. 3A is a perspective view of an EGM100 illustrating various physical features of the device, FIG. 3B is afunctional block diagram that schematically illustrates an electronicrelationship of various elements of the EGM 100, and FIG. 3C illustratesvarious functional modules that can be stored in a memory device of theEGM 100. The embodiments shown in FIGS. 3A to 3C are provided asexamples for illustrative purposes only. It will be appreciated thatEGMs may come in many different shapes, sizes, layouts, form factors,and configurations, and with varying numbers and types of input andoutput devices, and that embodiments of the inventive concepts are notlimited to the particular EGM structures described herein.

EGMs typically include a number of standard features, many of which areillustrated in FIGS. 3A and 3B. For example, referring to FIG. 3A, anEGM 100 may include a support structure, housing or cabinet 105 whichprovides support for a plurality of displays, inputs, outputs, controlsand other features that enable a player to interact with the EGM 100.

The EGM 100 illustrated in FIG. 3A includes a number of display devices,including a primary display device 116 located in a central portion ofthe cabinet 105 and a secondary display device 118 located in an upperportion of the cabinet 105. A plurality of game components 155 aredisplayed on a display screen 117 of the primary display device 116. Itwill be appreciated that one or more of the display devices 116, 118 maybe omitted, or that the display devices 116, 118 may be combined into asingle display device. The EGM 100 may further include a player trackingdisplay 140, a credit display 120, and a bet display 122. The creditdisplay 120 displays a player's current number of credits, cash, accountbalance or the equivalent. The bet display 122 displays a player'samount wagered.

The player tracking display 140 may be used to display a service windowthat allows the player to interact with, for example, their playerloyalty account to obtain features, bonuses, comps, etc. In otherembodiments, additional display screens may be provided beyond thoseillustrated in FIG. 3A.

The EGM 100 may further include a number of input devices that allow aplayer to provide various inputs to the EGM 100, either before, duringor after a game has been played. For example, the EGM 100 may include aplurality of input buttons 130 that allow the player to select optionsbefore, during or after game play. The EGM may further include a gameplay initiation button 132 and a cashout button 134. The cashout button134 is utilized to receive a cash payment or any other suitable form ofpayment corresponding to a quantity of remaining credits of a creditdisplay.

In some embodiments, one or more input devices of the EGM 100 are one ormore game play activation devices that are each used to initiate a playof a game on the EGM 100 or a sequence of events associated with the EGM100 following appropriate funding of the EGM 100. The example EGM 100illustrated in FIGS. 3A and 3B includes a game play activation device inthe form of a game play initiation button 132. It should be appreciatedthat, in other embodiments, the EGM 100 begins game play automaticallyupon appropriate funding rather than upon utilization of the game playactivation device.

In some embodiments, one or more input devices of the EGM 100 are one ormore wagering or betting devices. One such wagering or betting device isas a maximum wagering or betting device that, when utilized, causes amaximum wager to be placed. Another such wagering or betting device is arepeat the bet device that, when utilized, causes the previously-placedwager to be placed. A further such wagering or betting device is a betone device. A bet is placed upon utilization of the bet one device. Thebet is increased by one credit each time the bet one device is utilized.Upon the utilization of the bet one device, a quantity of credits shownin a credit display (as described below) decreases by one, and a numberof credits shown in a bet display (as described below) increases by one.

In some embodiments, one or more of the display screens may atouch-sensitive display that includes a digitizer 152 and a touchscreencontroller 154 (FIG. 3B). The player may interact with the EGM 100 bytouching virtual buttons on one or more of the display devices 116, 118,140. Accordingly, any of the above described input devices, such as theinput buttons 130, the game play initiation button 132 and/or thecashout button 134 may be provided as virtual buttons on one or more ofthe display devices 116, 118, 140.

Referring briefly to FIG. 3B, operation of the primary display device116, the secondary display device 118 and the player tracking display140 may be controlled by a video controller 30 that receives video datafrom a processor 12 or directly from a memory device 14 and displays thevideo data on the display screen. The credit display 120 and the betdisplay 122 are typically implemented as simple LCD or LED displays thatdisplay a number of credits available for wagering and a number ofcredits being wagered on a particular game. Accordingly, the creditdisplay 120 and the bet display 122 may be driven directly by theprocessor 12. In some embodiments however, the credit display 120 and/orthe bet display 122 may be driven by the video controller 30.

Referring again to FIG. 3A, the display devices 116, 118, 140 mayinclude, without limitation: a cathode ray tube, a plasma display, aliquid crystal display (LCD), a display based on light emitting diodes(LEDs), a display based on a plurality of organic light-emitting diodes(OLEDs), a display based on polymer light-emitting diodes (PLEDs), adisplay based on a plurality of surface-conduction electron-emitters(SEDs), a display including a projected and/or reflected image, or anyother suitable electronic device or display mechanism. In certainembodiments, as described above, the display devices 116, 118, 140 mayinclude a touch-screen with an associated touch-screen controller 154and digitizer 152. The display devices 116, 118, 140 may be of anysuitable size, shape, and/or configuration. The display devices 116,118, 140 may include flat or curved display surfaces.

The display devices 116, 118, 140 and video controller 30 of the EGM 100are generally configured to display one or more game and/or non-gameimages, symbols, and indicia. In certain embodiments, the displaydevices 116, 118, 140 of the EGM 100 are configured to display anysuitable visual representation or exhibition of the movement of objects;dynamic lighting; video images; images of people, characters, places,things, and faces of cards; and the like. In certain embodiments, thedisplay devices 116, 118, 140 of the EGM 100 are configured to displayone or more virtual reels, one or more virtual wheels, and/or one ormore virtual dice. In other embodiments, certain of the displayedimages, symbols, and indicia are in mechanical form. That is, in theseembodiments, the display device 116, 118, 140 includes anyelectromechanical device, such as one or more rotatable wheels, one ormore reels, and/or one or more dice, configured to display at least oneor a plurality of game or other suitable images, symbols, or indicia.

The EGM 100 also includes various features that enable a player todeposit credits in the EGM 100 and withdraw credits from the EGM 100,such as in the form of a payout of winnings, credits, etc. For example,the EGM 100 may include a ticket dispenser 136, a bill/ticket acceptor128, and a coin acceptor 126 that allows the player to deposit coinsinto the EGM 100.

While not illustrated in FIG. 3A, the EGM 100 may also include a notedispenser configured to dispense paper currency and/or a coin generatorconfigured to dispense coins or tokens in a coin payout tray.

The EGM 100 may further include one or more speakers 150 and amicrophone 151 controlled by one or more sound cards 28 (FIG. 3B). TheEGM 100 illustrated in FIG. 3A includes a pair of speakers 150. In otherembodiments, additional speakers, such as surround sound speakers, maybe provided within or on the cabinet 105. Moreover, the EGM 100 mayinclude built-in seating with integrated headrest speakers.

In various embodiments, the EGM 100 may generate dynamic sounds coupledwith attractive multimedia images displayed on one or more of thedisplay devices 116, 118, 140 to provide an audio-visual representationor to otherwise display full-motion video with sound to attract playersto the EGM 100 and/or to engage the player during gameplay. In certainembodiments, the EGM 100 may display a sequence of audio and/or visualattraction messages during idle periods to attract potential players tothe EGM 100. The videos may be customized to provide any appropriateinformation.

The EGM 100 may further include a card reader 138 that is configured toread magnetic stripe cards, such as player loyalty/tracking cards, chipcards, and the like. In some embodiments, a player may insert anidentification card into a card reader of the gaming device. In someembodiments, the identification card is a smart card having a programmedmicrochip or a magnetic strip coded with a player's identification,credit totals (or related data) and other relevant information. In otherembodiments, a player may carry a portable device, such as a cell phone,a radio frequency identification tag or any other suitable wirelessdevice, which communicates a player's identification, credit totals (orrelated data) and other relevant information to the gaming device. Insome embodiments, money may be transferred to a gaming device throughelectronic funds transfer. When a player funds the gaming device, theprocessor determines the amount of funds entered and displays thecorresponding amount on the credit or other suitable display asdescribed above.

In some embodiments, the EGM 100 may include an electronic payout deviceor module configured to fund an electronically recordable identificationcard or smart card or a bank or other account via an electronic fundstransfer to or from the EGM 100.

FIG. 3B is a block diagram that illustrates logical and functionalrelationships between various components of an EGM 100. As shown in FIG.3B, the EGM 100 may include a processor 12 that controls operations ofthe EGM 100. Although illustrated as a single processor, multiplespecial purpose and/or general purpose processors and/or processor coresmay be provided in the EGM 100. For example, the EGM 100 may include oneor more of a video processor, a signal processor, a sound processorand/or a communication controller that performs one or more controlfunctions within the EGM 100. The processor 12 may be variously referredto as a “controller,” “microcontroller,” “microprocessor” or simply a“computer.” The processor may further include one or moreapplication-specific integrated circuits (ASICs).

Various components of the EGM 100 are illustrated in FIG. 3B as beingconnected to the processor 12. It will be appreciated that thecomponents may be connected to the processor 12 through a system bus, acommunication bus and controller, such as a USB controller and USB bus,a network interface, or any other suitable type of connection.

The EGM 100 further includes a memory device 14 that stores one or morefunctional modules 20. Various functional modules 20 of the EGM 100 willbe described in more detail below in connection with FIG. 3D.

The memory device 14 may store program code and instructions, executableby the processor 12, to control the EGM 100. The memory device 14 mayalso store other data such as image data, event data, player input data,random or pseudo-random number generators, pay-table data or informationand applicable game rules that relate to the play of the gaming device.The memory device 14 may include random access memory (RAM), which caninclude non-volatile RAM (NVRAM), magnetic RAM (ARAM), ferroelectric RAM(FeRAM) and other forms as commonly understood in the gaming industry.In some embodiments, the memory device 14 may include read only memory(ROM). In some embodiments, the memory device 14 may include flashmemory and/or EEPROM (electrically erasable programmable read onlymemory). Any other suitable magnetic, optical and/or semiconductormemory may operate in conjunction with the gaming device disclosedherein.

The EGM 100 may further include a data storage device 22, such as a harddisk drive or flash memory. The data storage 22 may store program data,player data, audit trail data or any other type of data. The datastorage 22 may include a detachable or removable memory device,including, but not limited to, a suitable cartridge, disk, CD ROM, DVDor USB memory device.

The EGM 100 may include a communication adapter 26 that enables the EGM100 to communicate with remote devices over a wired and/or wirelesscommunication network, such as a local area network (LAN), wide areanetwork (WAN), cellular communication network, or other datacommunication network. The communication adapter 26 may further includecircuitry for supporting short range wireless communication protocols,such as Bluetooth and/or near field communications (NFC) that enable theEGM 100 to communicate, for example, with a mobile communication deviceoperated by a player.

The EGM 100 may include one or more internal or external communicationports that enable the processor 12 to communicate with and to operatewith internal or external peripheral devices, such as eye trackingdevices, position tracking devices, cameras, accelerometers, arcadesticks, bar code readers, bill validators, biometric input devices,bonus devices, button panels, card readers, coin dispensers, coinhoppers, display screens or other displays or video sources, expansionbuses, information panels, keypads, lights, mass storage devices,microphones, motion sensors, motors, printers, reels, SCSI ports,solenoids, speakers, thumb drives, ticket readers, touch screens,trackballs, touchpads, wheels, and wireless communication devices. Insome embodiments, internal or external peripheral devices maycommunicate with the processor through a universal serial bus (USB) hub(not shown) connected to the processor 12. U.S. Patent ApplicationPublication No. 2004/0254014 describes a variety of EGMs including oneor more communication ports that enable the EGMs to communicate andoperate with one or more external peripherals.

In some embodiments, the EGM 100 may include a sensor, such as a camerain communication with the processor 12 (and possibly controlled by theprocessor 12) that is selectively positioned to acquire an image of aplayer actively using the EGM 100 and/or the surrounding area of the EGM100. In one embodiment, the camera may be configured to selectivelyacquire still or moving (e.g., video) images and may be configured toacquire the images in either an analog, digital or other suitableformat. The display devices 116, 118, 140 may be configured to displaythe image acquired by the camera as well as display the visiblemanifestation of the game in split screen or picture-in-picture fashion.For example, the camera may acquire an image of the player and theprocessor 12 may incorporate that image into the primary and/orsecondary game as a game image, symbol or indicia.

Various functional modules of that may be stored in a memory device 14of an EGM 100 are illustrated in FIG. 3C. Referring to FIG. 3C, the EGM100 may include in the memory device 14 a game module 20A that includesprogram instructions and/or data for operating a hybrid wagering game asdescribed herein. The EGM 100 may further include a player trackingmodule 20B, an electronic funds transfer module 20C, a wide areaprogressive module 20D, an audit/reporting module 20E, a communicationmodule 20F, an operating system 20G and a random number generator 20H.The player tracking module 20B keeps track of the play of a player. Theelectronic funds transfer module 20C communicates with a back end serveror financial institution to transfer funds to and from an accountassociated with the player. The AR interface module 20D interacts withan AR device 200 as described in more detail below. The communicationmodule 20F enables the EGM 100 to communicate with remote servers andother EGMs using various secure communication interfaces. The operatingsystem kernel 20G controls the overall operation of the EGM 100,including the loading and operation of other modules. The random numbergenerator 20H generates random or pseudorandom numbers for use in theoperation of the hybrid games described herein.

In some embodiments, an EGM 100 may be implemented by a desktopcomputer, a laptop personal computer, a personal digital assistant(PDA), portable computing device, or other computerized platform. Insome embodiments, the EGM 100 may be operable over a wireless network,such as part of a wireless gaming system. In such embodiments, thegaming machine may be a hand-held device, a mobile device or any othersuitable wireless device that enables a player to play any suitable gameat a variety of different locations. It should be appreciated that agaming device or gaming machine as disclosed herein may be a device thathas obtained approval from a regulatory gaming commission or a devicethat has not obtained approval from a regulatory gaming commission.

For example, referring to FIG. 3D, an EGM 100′ may be implemented as ahandheld device including a compact housing 105 on which is mounted atouchscreen display device 116 including a digitizer 152. An inputbutton 130 may be provided on the housing and may act as a power orcontrol button. A camera 127 may be provided in a front face of thehousing 105. The housing 105 may include one or more speakers 150. Inthe EGM 100′, various input buttons described above, such as the cashoutbutton, gameplay activation button, etc., may be implemented as softbuttons on the touchscreen display device 116. Moreover, the EGM 100′may omit certain features, such as a bill acceptor, a ticket generator,a coin acceptor or dispenser, a card reader, secondary displays, a betdisplay, a credit display, etc. Credits can be deposited in ortransferred from the EGM 100′ electronically.

FIG. 3E illustrates a standalone EGM 100″ having a different form factorfrom the EGM 100 illustrated in FIG. 3A. In particular, the EGM 100″ ischaracterized by having a large, high aspect ratio, curved primarydisplay device 116′ provided in the housing 105, with no secondarydisplay device. The primary display device 116′ may include a digitizer152 to allow touchscreen interaction with the primary display device116′. The EGM 100″ may further include a player tracking display 140, aplurality of input buttons 130, a bill/ticket acceptor 128, a cardreader 138, and a ticket generator 136. The EGM 100″ may further includeone or more cameras 127 to enable facial recognition and/or motiontracking.

Augmented Reality Applications

As more and more AR viewing devices 200 become available to players,manufacturers of EGMs may desire to incorporate support for such devicesinto their machines and games played on the machines. This presents aproblem for EGM manufacturers, because significant programming effortmay be required to support such devices. For example, EGM manufacturersmay have to provide programming to define what animations are shown byan AR device, where and how such animations are displayed to a player,when the animations can be displayed to a player, and the like. Suchactions require not only a large amount of programming, but also consumesignificant computing resources when performed in real time. Someembodiments of the inventive concepts provide a communication interfaceby which an EGM can integrate AR device support with a relatively lowamount of customization. According to some embodiments, an EGM 100 maycommunicate to an AR device where on or near the EGM an animation can bedisplayed and notify the AR device 200 of a triggering event for theanimation, but the actual processing to determine exactly where, whenand how to display the animation may be performed by the AR device 200and/or an AR controller 70.

In some embodiments, an AR device 200 can be used in conjunction with anEGM to display portions of a game on the EGM to a player. In particular,an AR device 200 may be used to display game elements, game components,game information, game animation and/or other elements to a player whilethe player is engaged in playing a game on the EGM 100. For example, anAR device 200 may be configured to display a special three-dimensionalanimation when a player wins a game, earns a prize, is awarded a bonusgame, etc. The AR device 200 may display the special 3D animation withinthe player's field of view, which may include the display screen of theEGM 100. For example, the AR device 200 may display the special 3Danimation to appear as if it is on the display screen or bursting out ofthe display screen. Such animations, rendered in three dimensions insuch a way that they appear to the player to be part of a real scene,can enhance the game play experience for the player. However, when thespecial 3D animation is displayed, a portion of the display screen ofthe EGM 100 may be obscured by the special 3D animation.

Similarly, an AR device 200 can be used to display information about thestate of the EGM 100 to the player that would normally displayed to theplayer in some other way, such as credit information, bet information,bonus status, paytables, etc. Some information that is displayed to theplayer includes information that is required by law or regulation to bedisplayed, or that is contractually required to be displayed, such astrademark or copyright information. When such information is displayedto the player by the AR device 200, it may be possible to free upvaluable screen space on the EGM display screen for game components.These and other applications will be discussed in more detail below.

In some embodiments, the EGM 100 may inform the AR device 200 about thestate of the EGM. This may include information such as: game screenlayout and elements, reel positions and state, payline locations andstate, service window location and state, the location of 2D and 3Delements on the screen. The EGM 100 may further inform the AR device 200about changes in state, such as wins, losses, credit meter changes, winanimations, payline wins, reel start, stop, lock, or change indirection/velocity, etc. In some embodiments, the EGM 100 may inform theAR device 200 about cabinet events, such as credit deposit/withdrawal.The EGM 100 may further inform the AR device 200 about player inputs,such as button presses, touch screen inputs, and the like. Additionally,the EGM 100 may inform the AR device 200 about the configuration of theEGM cabinet, such as location of various devices on the cabinet (displayscreens, input devices, card readers, etc.) For example, the EGM 100 mayprovide information to the AR device 200 about the location of monitors,whether they are primary or secondary, the location and function ofmonetary devices (e.g., bill acceptors, card readers, etc.), and whetherthey are active or disabled, and the location and status of gamedevices, such as reels, wheels, lights, etc.

With this information the AR device 100 can coordinate with the game onthe EGM 100 to display AR graphics and/or other information to theplayer. Since the AR device 200 knows the location of various elementsof the EGM 100, it can coordinate that and incorporate that into the ARexperience.

For example, in an embodiment, the EGM 100 may notify the AR device 200that a payline win has been triggered on payline 3 with 4 cherrysymbols. The AR device 200 may cause an explosion to virtually come outof that payline since it now knows the information. Thus, the AR device200 knows there is a win, why there is a win and where the win is beingdisplayed on the EGM screen. In another example the AR device 200 may beinformed by the EGM 100 when the reels have just started spinning so theAR device 200 may overlay an AR graphic that matches or complements thereel spin. In another example the AR device 200 may learn that theplayer has chosen a losing value in a pick bonus, and may display an ARgraphic including a virtual character encouraging the player to keepplaying. The AR graphic can interact with known elements of the EGM 100or the display screen. For example, the virtual character might point atthe losing elements or point at other elements on the game screen sincethe AR device 200 knows the location and purpose of all the elements onthe screen.

The EGM 100 can also notify the AR device 200 about certain criticalgame-related information. For example, such information may includeregulatory and legal information, such as the location and informationof the credit meter, the location and information of the door iconstatus, the game language, the game denomination, the game speed, thelocation and occurrence of any tilts, copyrighted material and otherinformation that must be shown due to legal or contractual requirements,such as a brand or logo. With this information the AR device 200 canensure that an AR graphic displayed by the AR device 200 to the playerdoes not obscure these key items.

FIG. 4A illustrates an example of a display screen 117 of an EGM 100 onwhich a game view 400 is displayed. The illustrated game is a virtualslot game, and the game view includes a title 408 (“Fruit Mania™”) andfive virtual slot reels 412 on which a plurality of symbols 413 aredisplayed. Payline indicators 418 are provided beside the slot reels412, and a credit display 414, amount won display 416 and bet display420 that provide information to the player are provided below thevirtual reels 412. Referring to FIG. 4B, the game view 400 can bedivided into a plurality of regions, including a title region 442 wherethe title is displayed, game element regions 444 which correspond to thevirtual reels 412, side regions 446, 450 beside the game element regionsand an informational region 448, below the game element regions 444,where the credit display 414, amount won display 416 and bet display 420are shown. The EGM 100 may communicate the dimensions of the screen 117and the layout of the game view 400 to an AR device 200, and the ARdevice may use this information to determine where to display ARgraphics to the player.

Brief reference is made to FIG. 4C, which is a timeline that illustratesvarious phases of operation of an EGM 100. Before a player has signedinto the EGM 100 (using, for example, a player reward card) or depositedcredits into the EGM 100, the EGM 100 may be in “attract mode”, duringwhich time the EGM may display a video and/or play sounds or musicintended to attract a player. Once a player deposits credits into theEGM 100 or signs into the EGM 100, the EGM 100 may enter a game mode inwhich it displays a screen prompting the player to make a wager. Beforethe player makes a wager, the EGM 100 may be said to be in a “pre-play”mode in which the EGM 100 displays wagering options to the player. Oncethe player has made the wager, e.g., by selecting a wager amount andpressing a “spin” button or the like, the game enters an “in-play” modeduring which the EGM 100 may display various graphics, such as spinningreels or moving tiles, to the player. Once the game has concluded thewager outcome is displayed to the player in a “post-play” mode, afterwhich the game reverts to the “pre-play” mode. It will be appreciatedthat in some cases, the pre-play mode may be bypassed by the player insome games, for example, if the player presses the spin button toinitiate a new game while the game is in “post-play” mode. This processis typically repeated a number of times by the player until the playerhas no credits left or the player decides to cash out or sign out of theEGM 100. At that point, the EGM 100 returns to attract mode.

Referring again to FIG. 4B, each of the regions 442, 444, 446, 448, 450may have an associated value or code that indicates whether and/or whenthe AR device can use that area to display AR graphics to the player.For example, the regions shown in FIG. 4B are coded with a 0, 1, 2 or 3.Each of these codes may indicate when the AR device 200 may use thatregion to display an AR graphic. For example, codes may indicate thatthe AR device can use the associated region to display an AR graphic asindicated in Table 1 below:

TABLE 1 Display region availability codes Code Display RegionAvailability 0 Never 1 Post-play only 2 Pre-play only 3 Any time

The regions 442, 444, 446, 448, 450 may be indicated to the AR device200 as windows identified by their height, width and location relativeto the coordinates of the display screen 116. As indicated in Table 1, aregion having a code “0” can never be used by the AR device 200 todisplay an AR graphic, while a region having a code “3” can always beused by the AR device 200 to display an AR graphic. A region having acode “1” can be used by the AR device 200 to display an AR graphic onlywhen the game is in post-play mode, while a region having a code “2” canbe used by the AR device 200 to display an AR graphic only when the gameis in pre-play mode. Many other variations are possible. For example, atime period may be defined during a bonus game that is separate from amain game. Moreover, regions may be defined both over a display screen117 of a display unit or outside the display screen 117. Another examplemethod would be for the EGM 100 to notify the AR device 200 of thestatus of each region when the EGM 100 notifies the AR device 200 aboutevents, as described below.

The EGM 100 may notify the AR device 200 of in-game or out-of-gameevents that may trigger the AR device to display AR graphics to theplayer. For example, FIG. 4D illustrates an example in which a reel spinresults in a win on payline 1. The AR device 200 may display an ARgraphic 460 (in this case, a three-dimensional explosion) to the playerin a location that overlays one or more screen elements on the displayscreen 117. This is an example of a post-play event, because it occursafter the wager outcome has been determined. Because the AR device 200knows what areas of the screen are available for display of AR graphicsin a post-play mode, the AR device 200 can choose an appropriate placeto display the AR graphic 460 so that it does not conceal any screenelements that should not be concealed in post-play mode. In thisexample, the AR graphic overlays part of the game element region 444 andside region 450 (shown in FIG. 4B), which are available for overlay ofAR graphics in post-play mode.

In some embodiments, a screen area may be available for the AR device200 to use to display AR graphics provided the AR device displays theoccluded information separately to the player. This would allow the ARdevice 200 to block player's view of the information on the screen, butstill present the information virtually off screen. For example,referring to FIG. 4E, the AR device may display an AR graphic 460 thatat least partially obscures the credit meter 414 and the win meter 416.The AR device 200 may display a 2D or 3D window 470 to the side of thescreen 117 that includes a virtual credit meter 474 and a virtual winmeter 476. In this way, the AR device 200 can ensure that anyinformation that needs to be continuously displayed to the player can bedisplayed even though the AR device 200 displays an AR graphic 460 overthe location of such information on the screen 117.

Similarly, the AR device 200 can also display other elements obtainedfrom the EGM 100, such as the game logo, the copyright notice and/orgame instructions, thereby freeing up screen space to be used for ARgraphics.

Referring to FIG. 4F, the AR device 200 may display additionalinformation to the player in a similar manner, such as by displaying avirtual information box 480 to the player outside the screen 117containing instructions or other information about the game to theplayer. Such additional information may be provided by the EGM 100 tothe AR device 200 along with a command to display the information in amanner that does not occlude the screen 117. The AR device 200 may thendetermine how and where to display the information to the player.

Since the AR device 200 can display information to the player on behalfof the EGM 100, the AR device 200 may also enable the player to provideinput via the AR device 200. For example, the EGM 100 may notify the ARdevice 200 that the current denomination of the game is 25 cents andthat the possible denominations are 5, 25, 100, 250 cents. The AR device200 can show this information to the player in an overlay and allow theplayer to select a new denomination, for example, by looking at thedesired denomination and saying a command, such as “select”. The ARdevice 200 may then notify the EGM 100 of the newly selecteddenomination.

In some embodiments, the AR device 200 may display information to theplayer on behalf of the EGM 100, and the EGM 100 may consequently notshow this information, which can free up screen space for additionalgame graphics. For example, screen elements, such as a button panel,game logo, credit meter, door icons, service window, etc., that arerequired to be displayed by the EGM 100 and that would otherwise take upspace on the screen 117 may be displayed instead by the AR device 200.The EGM 100 can provide the information about all the required screenelements to the AR device 200, and the AR device 200 can display theinformation and notify the EGM 100 that the information is beingdisplayed. In some embodiments, the EGM 100 can enter a “full screen”mode and use the entire display space for game elements. This mayprovide the player with a better game experience, because more of themonitor space can be used for the game experience.

This technique may also facilitate the integration of a new game, suchas an arcade-style game that was not designed for casino gaming, moreeasily into a casino gaming environment. For example, a game developedas an arcade-style game may not have been designed with screen space forrequired screen elements, such as credit meters, button panels, dooricons, tilts, etc. To migrate such a game to the casino market, someeffort will be required to insert these elements, which may adverselyimpact the graphical content or game play of the original game. With theAR protocol described herein, an AR device 200 may be used to show anynecessary additional screen elements for the game which would thenrequire fewer changes to the original game to be introduced into thegaming market.

In some embodiments, AR devices 200 may be worn by viewers other thanthe player of the EGM 100, such as by a spouse/friend of the player,regulator or casino personnel. For a non-player, the AR device 200 mayoverlay different information. For example, a player's AR device 200would be required to not obscure some screen elements, such as thecredit meter, while the AR device of a non-player observer would allowthe AR device to obscure such elements.

FIG. 5A is a flow diagram illustrating message flows between the ARdevice 200 and the EGM 100 according to some embodiments. As showntherein, the AR device 200 may initiate a session 502 with an EGM (block502), for example, via a pairing operation in the case of a Bluetoothconnection. The session initiation may take place after the EGM 100 hasentered game mode (FIG. 4C) and/or may cause the EGM 100 to enter gamemode. Once a session has been initiated, the EGM 100 may proceed totransmit information about the EGM 100 to the AR device, such as the EGMcabinet layout 504 and the game screen arrangement 506. The AR device200 may also notify the EGM 100 of its configuration (software version,hardware version, etc.) and compatibilities. The EGM 100 may alsotransmit event graphics 508 to the AR device 200 for the AR device touse in the generation of AR graphics. The event graphics may includecolors, fonts, textures, bitmaps, 3D models, still or moving images,etc. The EGM 100 may also specify what events the event graphics shouldbe used for. The screen information may specify, for example, locationson the EGM screen that are available or unavailable for the display ofAR graphics.

In the example shown in FIG. 5A, the player initiates a game on the EGM100 at block 510. When an in-game event occurs during game play, the EGM100 may notify the AR device of the in-game event (arrow 512). Thein-game event may include a reel spin, a win, loss, bonus award, or anyother event that can occur in the game. In response to receiving thenotification of the in-game event, the AR device 200 may display an ARgraphic associated with the in-game event to the player at block 514.Based on the information provided to the AR device 200 by the EGM 100regarding the EGM, the display screen and the event, the AR device maydetermine where to display the AR graphic, what size to display the ARgraphic, and/or what event graphics to use for the AR graphic. Becausethe AR device 200 makes these decisions, the computational processingload on the EGM 100 may be reduced. Moreover, the bandwidth requirementsfor the connection between the EGM 100 and the AR device 200 may bereduced, as the EGM 100 may not have to transmit 3D rendering data tothe AR device 200 over the connection.

Still referring to the example of FIG. 5A, after displaying the ARgraphic at block 514, the current game ends (block 516). An out-of-gameevent may then occur, such as a player adding credits to the machine.The EGM 100 notifies the AR device 200 of the out-of-game event (arrow518). In response, the AR device 200 may display an AR graphicassociated with the out-of-game event to the player (block 520).Finally, the session terminates at block 422.

FIG. 5B is a flow diagram illustrating message flows between the ARdevice 200, the EGM 100 and an AR controller 70 according to someembodiments. As shown therein, the AR device 200 may initiate a session502 with an EGM (block 502), for example, via a pairing operation in thecase of a Bluetooth connection. The AR device 200 may inform the ARcontroller 70 that the session has been initiated in a message 550. Insome embodiments, the AR device 70 may participate in the set-up of thesession between the AR device 200 and the EGM 100.

Once a session has been initiated, the AR controller may obtaininformation about the EGM 100, such as the EGM cabinet layout (block552) and the game screen arrangement (block 554). The information aboutthe EGM may be obtained from a database of game information provided tothe AR controller 70 in advance, or may be obtained directly orindirectly from the EGM 100. The screen information may specify, forexample, locations on the EGM screen that are available or unavailablefor the display of AR graphics. The AR controller 70 may also obtainevent graphics (block 556) associated with the EGM 100 for the AR device200 to use in the generation of AR graphics.

In the example shown in FIG. 5B, the player initiates a game on the EGM100 at block 510. When an in-game event occurs during game play, the EGM100 may notify the AR device of the in-game event (arrow 512). The ARdevice 200 may forward the in-game event notification to the ARcontroller 70 in a message 562, and the AR controller 70 may, inresponse, provide an AR graphic to the AR device 200 along with locationinformation indicating where the AR graphic should be displayed. Thatis, based on the information obtained by the AR controller 70 about theEGM 100, the display screen and the event, the AR controller maydetermine what AR graphic to display, where to display the AR graphic,what size to display the AR graphic, etc., and provide such informationto the AR device 200.

In response to receiving AR graphic and location information from the ARcontroller 70, the AR device 200 may display the AR graphic to theplayer at block 514. Because the AR controller 70 makes the decisionsabout what graphic to display and where to display the graphic, thecomputational processing load on both the AR device 200 and the EGM 100may be reduced. Moreover, the bandwidth requirements for the connectionbetween the EGM 100 and the AR device 200 may be reduced, as the EGM 100may not have to transmit 3D rendering data to the AR device 200 over theconnection.

In some embodiments, the communication link between the AR device 200and the AR controller 70 may have a higher bandwidth than thecommunication link between the AR device 200 and the EGM 100. Forexample, the communication link between the AR device 200 and the ARcontroller 70 may be a high speed Wifi connection, while thecommunication link between the AR device 200 and the EGM 100 may be amore limited NFC or Bluetooth connection.

Still referring to the example of FIG. 5B, after displaying the ARgraphic at block 514, the current game ends (block 516). An out-of-gameevent may then occur, such as a player adding credits to the machine.The EGM 100 notifies the AR device 200 of the out-of-game event (arrow518). The AR device 200 may notify the AR controller 70 of theout-of-game event in a message 566, and the AR controller 70 may respondwith an AR graphic and location to be displayed by the AR device 200.The AR device 200 may then display the AR graphic associated with theout-of-game event to the player (block 520). Finally, the sessionterminates at block 422.

Operations of an EGM 100 according to some embodiments are illustratedin the flowcharts of FIGS. 6 and 7. Referring to FIG. 6, an EGM 100 mayestablish a data communications connection with an AR device 200 (block602). In particular, the connection may be a wireless link, such as aWifi, Bluetooth or NFC connection with the AR device 200. The datacommunications connection may be established with assistance from an ARcontroller 70. The EGM 100 may display a game element in a first screenarea of a display screen of the EGM 100 (block 604) and transmit screenlocation data to the AR device 200 that identifies a second screen area,different from the first screen area, that is available for use by theAR device 200 to display an AR graphic (block 606). In some embodiments,the EGM 100 may transmit a game element to the AR device 200 to bedisplayed as an AR graphic in the second screen area and/or outside anarea of the display screen.

The screen location data may include, for example, a reel position of avirtual reel displayed on the display screen, a payline location, aservice window location and/or a credit meter location. In someembodiments, the EGM 100 may transmit a state or change of state of thegame to the AR device 200, and the AR device 200 may determine where todisplay an AR graphic based on the state or change of state of the game.In some embodiments, the EGM 100 may transmit a state or change of stateof a game element, such as a reel state of a virtual reel displayed onthe display screen, a payline state, a service window state, paylinewins, credit meter changes, win animations, and/or system events thegame to the AR device 200, and the AR device 200 may display an ARgraphic in response to the state or change of state.

In still further embodiments, the EGM 100 may transmit information tothe AR device about location of a peripheral device on a cabinet of theelectronic gaming machine outside the display screen, and the AR device200 may use such information to determine where to display an ARgraphic.

Referring to FIG. 7, in some embodiments, an EGM 100 may establish adata communications connection with an AR device 200 (block 702). Thedata communications connection may be established with assistance froman AR controller 70. The EGM 100 may display a game element in a firstscreen area of a display screen of the EGM 100 (block 704) and transmitscreen location data to the AR device 200 that identifies the firstscreen area as being unavailable for use by the AR device 200 to displayan AR graphic (block 706).

Operations of an AR device 200 according to some embodiments areillustrated in FIGS. 8 and 9. Referring to FIG. 8, an AR device 200 mayestablish a data communications connection to an EGM 100, such as aWifi, Bluetooth of NFC connection to the EGM 100 (block 802). The datacommunications connection may be established with assistance from an ARcontroller 70. The AR device 200 receives screen location data from theEGM 100 identifying a first screen area of a display screen of the EGM100 (block 804). The AR device receives an event notification from theEGM 100 informing the AR device of the occurrence of an in-game event orout-of-game event (block 806). In response to the event notification,the AR device 200 displays an AR graphic associated with the eventwithin the identified first screen area (block 808).

Referring to FIG. 9, in some embodiments, an AR device 200 may establisha communications connection to an EGM 100 (block 902). The datacommunications connection may be established with assistance from an ARcontroller 70. The AR device 200 receives screen location data from theEGM 100 identifying a first screen area of a display screen of the EGM100 that is not available for displaying AR graphics (block 904). The ARdevice receives an event notification from the EGM 100 informing the ARdevice of the occurrence of an in-game event or out-of-game event (block906), and in response to the notification displays an AR graphic outsidethe identified first screen area so that the AR graphic does not obscureinformation displayed by the EGM 100 in the first screen area (block908).

AR Controller

FIG. 10 is a block diagram that illustrates various components of an ARcontroller 70 according to some embodiment. As shown in FIG. 10, the ARcontroller 70 may include a processor 72 that controls operations of theAR controller 70. Although illustrated as a single processor, multiplespecial purpose and/or general purpose processors and/or processor coresmay be provided in the AR controller 70. For example, the AR controller70 may include one or more of a video processor, a signal processor, asound processor and/or a communication controller that performs one ormore control functions within the AR controller 70. The processor 72 maybe variously referred to as a “controller,” “microcontroller,”“microprocessor” or simply a “computer.” The processor may furtherinclude one or more application-specific integrated circuits (ASICs).

Various components of the AR controller 70 are illustrated in FIG. 10 asbeing connected to the processor 72. It will be appreciated that thecomponents may be connected to the processor 72 through a system bus, acommunication bus and controller, such as a USB controller and USB bus,a network interface, or any other suitable type of connection.

The AR controller 70 further includes a memory device 74 that stores oneor more functional modules 76 for performing the operations describedabove.

The memory device 74 may store program code and instructions, executableby the processor 72, to control the AR controller 70. The memory device74 may include random access memory (RAM), which can includenon-volatile RAM (NVRAM), magnetic RAM (ARAM), ferroelectric RAM (FeRAM)and other forms as commonly understood in the gaming industry. In someembodiments, the memory device 14 may include read only memory (ROM). Insome embodiments, the memory device 14 may include flash memory and/orEEPROM (electrically erasable programmable read only memory). Any othersuitable magnetic, optical and/or semiconductor memory may operate inconjunction with the gaming device disclosed herein.

The AR controller 70 may include a communication adapter 78 that enablesthe AR controller 70 to communicate with remote devices, such as EGMs100 and/or a player tracking server 45 (FIG. 1) over a wired and/orwireless communication network, such as a local area network (LAN), widearea network (WAN), cellular communication network, or other datacommunication network.

The AR controller 70 may include one or more internal or externalcommunication ports that enable the processor 72 to communicate with andto operate with internal or external peripheral devices, such as displayscreens, keypads, mass storage devices, microphones, speakers, andwireless communication devices. In some embodiments, internal orexternal peripheral devices may communicate with the processor through auniversal serial bus (USB) hub (not shown) connected to the processor72.

Other EGM Features

Embodiments described herein may be implemented in variousconfigurations for EGMs 100 s, including but not limited to: (1) adedicated EGM, wherein the computerized instructions for controlling anygames (which are provided by the EGM) are provided with the EGM prior todelivery to a gaming establishment; and (2) a changeable EGM, where thecomputerized instructions for controlling any games (which are providedby the EGM) are downloadable to the EGM through a data network when theEGM is in a gaming establishment. In some embodiments, the computerizedinstructions for controlling any games are executed by at least onecentral server, central controller or remote host. In such a “thinclient” embodiment, the central server remotely controls any games (orother suitable interfaces) and the EGM is utilized to display such games(or suitable interfaces) and receive one or more inputs or commands froma player. In another embodiment, the computerized instructions forcontrolling any games are communicated from the central server, centralcontroller or remote host to a EGM local processor and memory devices.In such a “thick client” embodiment, the EGM local processor executesthe communicated computerized instructions to control any games (orother suitable interfaces) provided to a player.

In some embodiments, an EGM may be operated by a mobile device, such asa mobile telephone, tablet other mobile computing device.

In some embodiments, one or more EGMs in a gaming system may be thinclient EGMs and one or more EGMs in the gaming system may be thickclient EGMs. In another embodiment, certain functions of the EGM areimplemented in a thin client environment and certain other functions ofthe EGM are implemented in a thick client environment. In one suchembodiment, computerized instructions for controlling any primary gamesare communicated from the central server to the EGM in a thick clientconfiguration and computerized instructions for controlling anysecondary games or bonus functions are executed by a central server in athin client configuration.

The present disclosure contemplates a variety of different gamingsystems each having one or more of a plurality of different features,attributes, or characteristics. It should be appreciated that a “gamingsystem” as used herein refers to various configurations of: (a) one ormore central servers, central controllers, or remote hosts; (b) one ormore EGMs; and/or (c) one or more personal EGMs, such as desktopcomputers, laptop computers, tablet computers or computing devices,personal digital assistants (PDAs), mobile telephones such as smartphones, and other mobile computing devices.

In certain such embodiments, computerized instructions for controllingany games (such as any primary or base games and/or any secondary orbonus games) displayed by the EGM are executed by the central server,central controller, or remote host. In such “thin client” embodiments,the central server, central controller, or remote host remotely controlsany games (or other suitable interfaces) displayed by the EGM, and theEGM is utilized to display such games (or suitable interfaces) and toreceive one or more inputs or commands. In other such embodiments,computerized instructions for controlling any games displayed by the EGMare communicated from the central server, central controller, or remotehost to the EGM and are stored in at least one memory device of the EGM.In such “thick client” embodiments, the at least one processor of theEGM executes the computerized instructions to control any games (orother suitable interfaces) displayed by the EGM.

In some embodiments in which the gaming system includes: (a) an EGMconfigured to communicate with a central server, central controller, orremote host through a data network; and/or (b) a plurality of EGMsconfigured to communicate with one another through a data network, thedata network is an internet or an intranet. In certain such embodiments,an internet browser of the EGM is usable to access an internet game pagefrom any location where an internet connection is available. In one suchembodiment, after the internet game page is accessed, the centralserver, central controller, or remote host identifies a player prior toenabling that player to place any wagers on any plays of any wageringgames. In one example, the central server, central controller, or remotehost identifies the player by requiring a player account of the playerto be logged into via an input of a unique username and passwordcombination assigned to the player. It should be appreciated, however,that the central server, central controller, or remote host may identifythe player in any other suitable manner, such as by validating a playertracking identification number associated with the player; by reading aplayer tracking card or other smart card inserted into a card reader (asdescribed below); by validating a unique player identification numberassociated with the player by the central server, central controller, orremote host; or by identifying the EGM, such as by identifying the MACaddress or the IP address of the internet facilitator. In variousembodiments, once the central server, central controller, or remote hostidentifies the player, the central server, central controller, or remotehost enables placement of one or more wagers on one or more plays of oneor more primary or base games and/or one or more secondary or bonusgames, and displays those plays via the internet browser of the EGM.

It should be appreciated that the central server, central controller, orremote host and the EGM are configured to connect to the data network orremote communications link in any suitable manner. In variousembodiments, such a connection is accomplished via: a conventional phoneline or other data transmission line, a digital subscriber line (DSL), aT-1 line, a coaxial cable, a fiber optic cable, a wireless or wiredrouting device, a mobile communications network connection (such as acellular network or mobile internet network), or any other suitablemedium. It should be appreciated that the expansion in the quantity ofcomputing devices and the quantity and speed of internet connections inrecent years increases opportunities for players to use a variety ofEGMs to play games from an ever-increasing quantity of remote sites. Itshould also be appreciated that the enhanced bandwidth of digitalwireless communications may render such technology suitable for some orall communications, particularly if such communications are encrypted.Higher data transmission speeds may be useful for enhancing thesophistication and response of the display and interaction with players.

Examples of implementations of Internet-based gaming are furtherdescribed in U.S. Pat. No. 8,764,566, entitled “Internet Remote GameServer,” and U.S. Pat. No. 8,147,334, entitled “Universal Game Server,”which are incorporated herein by reference.

Further Definitions and Embodiments

In the above-description of various embodiments, various aspects may beillustrated and described herein in any of a number of patentableclasses or contexts including any new and useful process, machine,manufacture, or composition of matter, or any new and useful improvementthereof. Accordingly, various embodiments described herein may beimplemented entirely by hardware, entirely by software (includingfirmware, resident software, micro-code, etc.) or by combining softwareand hardware implementation that may all generally be referred to hereinas a “circuit,” “module,” “component,” or “system.” Furthermore, variousembodiments described herein may take the form of a computer programproduct comprising one or more computer readable media having computerreadable program code embodied thereon.

Any combination of one or more computer readable media may be used. Thecomputer readable media may be a computer readable signal medium or anon-transitory computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, or semiconductor system, apparatus,or device, or any suitable combination of the foregoing. More specificexamples (a non-exhaustive list) of the computer readable storage mediumwould include the following: a portable computer diskette, a hard disk,a random access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an appropriateoptical fiber with a repeater, a portable compact disc read-only memory(CD-ROM), an optical storage device, a magnetic storage device, or anysuitable combination of the foregoing. In the context of this document,a computer readable storage medium may be any tangible non-transitorymedium that can contain, or store a program for use by or in connectionwith an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device. Program codeembodied on a computer readable signal medium may be transmitted usingany appropriate medium, including but not limited to wireless, wireline,optical fiber cable, RF, etc., or any suitable combination of theforegoing.

Computer program code for carrying out operations for aspects of thepresent disclosure may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C #, VB.NET,Python or the like, conventional procedural programming languages, suchas the “C” programming language, Visual Basic, Fortran 2003, Perl, COBOL2002, PHP, ABAP, dynamic programming languages such as Python, Ruby andGroovy, or other programming languages. The program code may executeentirely on the user's computer, partly on the user's computer, as astand-alone software package, partly on the user's computer and partlyon a remote computer or entirely on the remote computer or server. Inthe latter scenario, the remote computer may be connected to the user'scomputer through any type of network, including a local area network(LAN) or a wide area network (WAN), or the connection may be made to anexternal computer (for example, through the Internet using an InternetService Provider) or in a cloud computing environment or offered as aservice such as a Software as a Service (SaaS).

Various embodiments were described herein with reference to flowchartillustrations and/or block diagrams of methods, apparatus (systems),devices and computer program products according to various embodimentsdescribed herein. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable instruction executionapparatus, create a mechanism for implementing the functions/actsspecified in the flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in anon-transitory computer readable medium that when executed can direct acomputer, other programmable data processing apparatus, or other devicesto function in a particular manner, such that the instructions whenstored in the computer readable medium produce an article of manufactureincluding instructions which when executed, cause a computer toimplement the function/act specified in the flowchart and/or blockdiagram block or blocks. The computer program instructions may also beloaded onto a computer, other programmable instruction executionapparatus, or other devices to cause a series of operational steps to beperformed on the computer, other programmable apparatuses or otherdevices to produce a computer implemented process such that theinstructions which execute on the computer or other programmableapparatus provide processes for implementing the functions/actsspecified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousaspects of the present disclosure. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be executed substantiallyconcurrently, or the blocks may sometimes be executed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustration, andcombinations of blocks in the block diagrams and/or flowchartillustration, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions.

The terminology used herein is for the purpose of describing particularaspects only and is not intended to be limiting of the disclosure. Asused herein, the singular forms “a”, “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, steps, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, steps, operations, elements, components, and/or groupsthereof. As used herein, the term “and/or” includes any and allcombinations of one or more of the associated listed items and may bedesignated as “/”. Like reference numbers signify like elementsthroughout the description of the figures.

Many different embodiments have been disclosed herein, in connectionwith the above description and the drawings. It will be understood thatit would be unduly repetitious and obfuscating to literally describe andillustrate every combination and subcombination of these embodiments.Accordingly, all embodiments can be combined in any way and/orcombination, and the present specification, including the drawings,shall be construed to constitute a complete written description of allcombinations and subcombinations of the embodiments described herein,and of the manner and process of making and using them, and shallsupport claims to any such combination or subcombination.

1. An electronic gaming machine, comprising: a processing circuit; adisplay screen coupled to the processing circuit; and a transceivercoupled to the processing circuit and configured to provide wirelesscommunications with an augmented reality (AR) display device that isseparate from the electronic gaming machine; wherein the processingcircuit: displays a game element in a first screen area of the displayscreen; and transmits screen location data to the AR display deviceidentifying a second screen area on the display screen, other than thefirst screen area, that is available for the AR display device tooverlay AR graphics in a field of view of a user of the AR displaydevice without overlaying the game element displayed in the first screenarea of the display screen.
 2. The electronic gaming machine of claim 1,wherein the game element comprises a first game element, and wherein theprocessing circuit transmits a second game element to the AR device fordisplay by the AR device in the second screen area of the displayscreen.
 3. The electronic gaming machine of claim 1, wherein theprocessing circuit transmits a second game element to the AR device fordisplay by the AR device outside of the display screen.
 4. Theelectronic gaming machine of claim 1, wherein the processing circuittransmits a state of the game element to the AR device, wherein thestate of the game element determines whether the AR device is permittedto overlay AR graphics in the field of view of the user of the AR deviceover the game element.
 5. The electronic gaming machine of claim 1,wherein the processing circuit further transmits a code to the AR devicethat indicates when the AR device can use the second screen area todisplay AR graphics.
 6. The electronic gaming machine of claim 1,wherein the screen location data comprises locations of game elementsthat are legally or contractually required to be displayed by theelectronic gaming machine.
 7. The electronic gaming machine of claim 1,wherein the screen location data comprises a reel position of a virtualreel displayed on the display screen, a payline location, a servicewindow location and/or a credit meter location.
 8. The electronic gamingmachine of claim 1, wherein the processing circuit transmits to the ARdevice a reel state of a virtual reel displayed on the display screen,payline state, service window state, payline wins, credit meter changes,win animations, and/or system events.
 9. The electronic gaming machineof claim 1, wherein the processing circuit transmits information to theAR device about location of a peripheral device on a cabinet of theelectronic gaming machine outside the display screen.
 10. The electronicgaming machine of claim 1, wherein the processing circuit transmits asecond game element to the AR device and to transmit a command to the ARdevice to display the second game element within the field of view ofthe user.
 11. The electronic gaming machine of claim 10, wherein theprocessing circuit transmits screen location data identifying a thirdscreen location, and wherein the command instructs the AR device todisplay the second game element to overlay the third screen location inthe field of view of the user.
 12. The electronic gaming machine ofclaim 1, wherein the screen location data identifies a plurality ofscreen areas in which game elements are displayed that are not to beobscured by images displayed by the AR device.
 13. An augmented realitydevice, comprising: a processing circuit; a transceiver coupled to theprocessing circuit; and a display device coupled to the processingcircuit and that displays virtual images within a field of view of auser; wherein the processing circuit receives, via the transceiver,screen location data from an electronic gaming machine including adisplay screen within the field of view of the user, the screen locationdata identifying a first screen area on the display screen; and whereinthe processing circuit displays a virtual game element in the field ofview of the user outside the first screen area of the display screen.14. The augmented reality device of claim 13, wherein the processingcircuit receives a game event from the electronic gaming machine, and todisplay the virtual game element in response to the game event.
 15. Theaugmented reality device of claim 13, wherein the screen location dataidentifies a second screen area on the display screen that is distinctfrom the first screen area, and wherein the processing circuit displaysthe virtual game element to overlay the second screen area on thedisplay screen.
 16. The augmented reality device of claim 15, whereinthe processing circuit receives a code that indicates when the AR devicecan display the virtual game element in the second screen area.
 17. Theaugmented reality device of claim 13, wherein the processing circuitdisplays the virtual game element outside the display screen.
 18. Theaugmented reality device of claim 13, wherein the processing circuitreceives a second virtual game element from the electronic gamingmachine and to display the second virtual game element within the fieldof view of the user.
 19. The augmented reality device of claim 18,wherein the processing circuit receives a state of the second gameelement and to display the second game element overlaying the firstscreen area of the display screen in response to the state of the secondgame element.
 20. The augmented reality device of claim 13, wherein thescreen location data comprises a reel position of a virtual reeldisplayed on the display screen, a payline location, a service windowlocation and/or a credit meter location. 21-22. (canceled)